An Analytical Approach to Connectivity in Regular Neuronal Networks 
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This paper describes how realistic neuromorphic networks can have their connectivity fully char- 
acterized in analytical fashion. By assuming that all neurons have the same shape and are regularly 
distributed along the two-dimensional orthogonal lattice with parameter A, it is possible to obtain 
the exact number of connections and cycles of any length from the autoconvolution function as well 
as from the respective spectral density derived from the adjacency matrix. It is shown that neuronal 
shape plays an important role in defining the spatial distribution of synapses in neuronal networks. 
In addition, we observe that neuromorphic networks typically exhibit an interesting phenomenon 
where the pattern of connections is progressively shifted along the spatial domain for increasing con- 
nection lengths. This is a consequence of the fact that in neurons the axon reference point usually 
does not coincide with the cell centre of mass. Morphological measurements for characterization 
of the spatial distribution of connections, including the adjacency matrix spectral density and the 
lacunarity of the connections, are suggested and illustrated. We also show that Hopfield networks 
with connectivity defined by different neuronal morphologies, quantified by the proposed analytical 
approach, lead to distinct performace for associative recall, as measured by the overlap index. The 
potential of the proposed approach is illustrated with respect to digital images of real neuronal cells. 

PACS numbers: 89.75.Fb, 87.18.Sn, 02.10.Ox, 89.75.Da, 89.75.Hc 
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I. INTRODUCTION 

A particularly meaningful way to understand neurons 
is as cells optimized for selective connections, i.e. con- 
necting between themselves in a specific manner so as 
to achieve proper circuitry and behavior. Indeed, the 
intricate shape of dendritic trees provide the means for 
connecting with specific targets while minimizingboth 
the cell volume and the implied metabolism (e.g. pj,l3l)- 
While great attention has been placed on the importance 
of synaptic strength over the emerging neuronal behav- 
ior, geometrical features such as the shape and spatial 
distribution of the involved neurons are closely related 
to the network connectivity. In addition, the topograph- 
ical organization and connections pervading the mam- 
mals' cortex provide further indication that adjacencies 
and spatial relationships are fundamental for informa- 
tion processing by biological neuronal networks. The im- 
portance of neuronal geometry has been reflected by the 
growing number of related works (see, for instance, H). 
However, most of such approaches target the character- 
ization of neuronal morphology in terms of indirect and 
incomplete measures such as area, perimeter and fractal 
dimension of the dendritic and axonal arborizations. In- 
teresting experimental results regarding the connectivity 
of neuronal cells growth in vitro have been reported in 
0, 0| and what is possibly the first direct computational 
approach to neuronal connectivity was only recently re- 
ported in jfj , involving the experimental estimation of the 
critical percolation density as neuronal cells are progres- 
sively superposed onto a two-dimensional domain. At 
the same time, the recent advances in complex network 
formalism (e.g. 0, H, U E3, El) provide a wealthy of 
concepts and tools for addressing connectivity. Initial 



applications of such a theory to bridge the gap between 
neuronal shape and function were reported in 
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As the investigation of the relationship between neu- 
ronal shape and function is underlined by computational 
approaches involving numerical methods and simulation, 
a need arises to develop an analytical framework for neu- 
romorphic characterization that could lead to additional 
insights and theoretical results regarding the relationship 
between neuronal shape and function. The present work 
describes an analytical approach capable of fully charac- 
terizing the connectivity of morphologically- realistic neu- 
ronal networks composed by repetitions of the same neu- 
ron along space. Such a kind of network can be con- 
sidered as a model of biological neuronal systems char- 
acterized by planarity and morphologic regularity, as is 
the case with ganglion cell retinal mosaics 0] and the 
basal dendritic arborization of cortical pyramidal cells. 
The basic idea underlying the proposed analytical ap- 
proach is to use the symmetries induced by the periodical 
boundary conditions in order to allow the connecting ma- 
trix describing the network to become a circulant matrix. 
Important features such as the number of connections 
and cycles can then be exactly obtained from the spec- 
trum of this matrix. Lacunarity is also considered as a 
complementary measurement of the connectivity pattern. 
The effect of different neuronal shapes over the dynam- 
ics of the respective neuronal systems (Hopfield) built 
upon such connections is then investigated by using the 
proposed methodology. It is shown that neuronal shape 
not only plays an important role in defining the spatial 
distribution of synapses in neuronal networks, but also 
imposes critical constraints over the respective behavior. 
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x x 
h(x) = f{x) *g{x) 




FIG. 1: The convolution of an axon function and a dendritic 
destribution 



II. METHODOLOGY 

The analytical representation of the connectivity of 
a neuronal network developed in the current section is 
based on the convolution of a function representing the 
neuronal cell with Dirac deltas. The basic adopted con- 
struction is illustrated in Figure^ where the convolution 
of the neuronal cell g(x) in (b) with the Dirac delta f(x) 
in (a) produces as effect a copy of the original cell at the 
position of the delta (c). This can be mathematically 
expressed as: 



D3 = S{s + da) 
d 3 




d2 D2 = 5(s + d 2 ) 



Dl = d(s + di) 



FIG. 2: The geometry of a simplified neuronal cells repre- 
sented in terms of its axon A, soma centroid S and dendrite 
points Di. 




6(a) * g(x) = g(x - a) (1) 

Let the neuronal cell be represented in terms of the 
triple r\ — [A, S, D] where A is the set of points be- 
longing to its axonal arborization, S is the set of points 
corresponding to the respective soma (neuronal body) 
and D are the dendritic arborization points. For sim- 
plicity's sake, a finite and discrete neuronal model is 
considered prior to its continuous general formulation. 
We therefore assume that the points used to represent 
the neuron belong to the square orthogonal lattice f2 = 
{1, 2, . . . , N} x {1, 2, . . . , N}, with parameter A = 1. The 
axon and soma are represented by a single point each. 
Such points could be understood as corresponding to the 
tip of the axon and the soma center of mass, respectively. 
The dendritic arborization is represented in terms of the 
finite set of dendrite points D = D\, D2, ■ ■ . , Dm and, in 
order to prevent the formation of loops, it is henceforth 
assumed that a dendrite point never coincides with the 
axon. Figure |21 illustrates such a geometrical representa- 
tion for a neuron with 3 dendrite points. Observe that 
the coordinate origin coincides with the axon, which is 
taken as reference for the soma and dendrite coordinates. 
Observe that the arrows in this figure refer to the relative 
positions of the soma and dendrites and not to the signal 



FIG. 3: The neurons connected through unit-length paths to 
neuron i which is placed with its axon A at p can be obtained 
through the convolution between the position 5(p) of neuron 
i with the dendritic structure function. 



transmission by a real neuronal cell, which occurs in the 
opposite direction (i.e. from dendrites to axon). 

Neuromorphic networks (actually digraphs 8i]) can 
now be obtained by placing one such a neuron at all pos- 
sible nodes of the orthogonal lattice fi. 

A connection is established whenever an axon is over- 
laid onto a dendrite point. The thus obtained connection 
pattern stands out as a particularly important feature of 
the obtained network, as it defines the possible communi- 
cations between the cells. Consequently, it is important 
to obtain analytical expressions describing the respective 
neuronal connectivity, e.g. by considering the spatial dis- 
tribution of paths and cycles of any specific length along 
the network. 

We start by considering the connections with a single 
specific neuron i placed with its axon at position p, illus- 
trated in Figure|3]together with four other neuronal cells 
at positions c{, cj, C3 and C4. Given the particular geom- 
etry of the basic cell, three connections are implied with 



the cells at cl, c% and 63 whose dendrites coincide with 
the axon of the cell i. In the case of cell cl, this situation 
can be mathematically expressed as c\ = p — d\ — s. The 
fourth cell cl illustrates one of the many neurons which 
are not connected to cell i. Two directly connected cells 
are henceforth represented as two nodes of a graph con- 
nected by a unit-length path (a simple arc). 

As is clear from such a construction, the set of neurons 
connected to i through unit-length paths can be obtained 
by convolving the initial point S(p) (the tip of the 
axon) with the function g(x 1 y) representing the neuronal 
cell 

g(x, y) = 5{-dx - s) + S(-d 2 - s) + 6{-d 3 - s). (2) 

Observe that the minus signs in this equation are im- 
plied by the need to flip the function representing the cell 
shape along both axes, so as to obtain proper propagation 
of the connections. For instance, in Figure |3J the propa- 
gation of information proceeds from the original axon at 
p to the dendrites at cl, 62, and C3. 

More generally given a set of initial neurons with axons 
represented as a Dirac's delta distribution £(x,y), the 
density of dendrites connected to those neurons by unit- 
path lengths can be obtained from Equation [31 Observe 
that ^(x, y) may contain Dirac deltas with intensity larger 
than one, resulting from sums of coinciding deltas. The 
function v(x, y) in Equation^Jis analogous to y) but 
here all Dirac deltas have unit intensity. The functions 
expressing the density of the dendrites connected to the 
original neurons through paths of length k is given by 
Equation The number of connections with length k is 
given by Equation |SJ Observe that the use of the Dirac 
delta function in such a formulation allows the immediate 
extension of such results to continuous spatial domains. 

While the analytical characterization of the connectiv- 
ity of the considered network model has been allowed by 
the fact that identical neuronal shapes are distributed 
along all points of the orthogonal lattice, it is interesting 
to consider extensions of such an approach to other sit- 
uations. An immediate possibility is to consider sparser 
configurations, characterized by larger lattice parameters 
A. Such an extension involves sampling the neuronal cell 
image at larger steps. 



x(x,y) = g(x,y) *£(x,y) 



(3) 



nx,y) = < n ,, . (4) 

l) otherwise. 








(e) 



(f) 



FIG. 4: Two real neuronal cells (a-b) and their respective 
total number of connections of length k — 2 (c-d) and 3 (e-f). 
The axon has been placed at the cell centroid (considering 
soma plus dendrites) . The neuronal cell figures in (a) and (b) 
are adapted with permission from [l4|. 




(a) 



(b) 




(c) 



(d) 



Xk(x, y) = g(x, y) * ... * g{x, y) £{x, y) 



fcx 



Tk(x,y) = J2(xj(x,y)) 



(5) 
(G) 



FIG. 5: The total number of connections of length k = 1 (a), 
2 (b), 3 (c) and 4(d) for the neuronal cell in Figure ^a) with 
the axon placed over the cell centroid, which is itself displaced 
from the cell centroid by s = (0, 7) pixels. 
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FIG. 6: The circulating scheme. 



Figure 0| shows two digital images obtained from real 
ganglion cells, (a) and (b), and their respective func- 
tions Xk{x,y) for k = 2 and 3. The axon has been 
placed over the centroid of the neuronal shape (including 
soma and dendrites), whereas the dendritic trees have 
been spatially sampled into 2033 and 671 pixels, respec- 
tively. Figure shows Xk(x,y) obtained for the cell in 
Figure Ufa) but with the soma located at the cell cen- 
ter of mass, which is displaced from the cell centroid by 
s = (0, 7) pixels. It is clear from such results that the 
neuron morphology strongly determines the connectiv- 
ity between cells in two important senses: (i) the spatial 
scattering of the dendrite points influences the connec- 
tivity distribution and (ii) the relative position of the 
axon defines how the centroid of the connections shifts 
for increasing values of k. While the increased num- 
ber of synaptic connections implied by denser neuronal 
shapes is as expected, it is clear from the example in Fig- 
ure that the distance from axon to cell center of mass 
implies spatial displacement of the connection pattern. 
Given the predominantly two-dimensional structure of 
the mammals' cortex, such an effect provides an inter- 
esting means to transmit information horizontally along 
such structures. In other words, faster signal transmis- 
sion along the cortical surface is achieved whenever the 
axon is placed further away from the dendritic tree. As 
the proper characterization, classification, analysis and 
simulation of neuromorphic networks are all affected by 
these two interesting phenomena, it is important to de- 
rive objective related measurements. The next section 
addresses the characterization of the morphology of such 
networks. 



III. MORPHOLOGY 

Let P(x, y) be a density function obtained by normal- 
izing Xk{x,y), i.e. 



P(x,y) 



x(x,y) 



jT oc x(x,y)dxdy 



(7) 



Thus, the spatial scattering of the connections can 
be quantified in terms of the respective covariance ma- 
trix Kk, and the spatial displacement of the centroid of 
P{x, y) can be quantified in terms of the 'speed' v = \s\ \. 
Additional geometrical measurements of the evolution of 
the neuronal connectivity that can be derived from the 
covariance matrix K include the angle that the distri- 
bution main axis makes with the x-axis and the ratio pk 
between the largest and smallest respective eigenvalues. 

Another interesting network feature related to connec- 
tivity is its number Ci t k of cycles of length I established 
by the synaptic connections. This feature can be calcu- 
lated from the enlarged matrix A obtained by stacking 
the columns of the matrix where the neuronal cell image 
is represented in order to obtain the rows of A, while the 
reference point of the cell is shifted along the main di- 
agonal of A. Figure presents the boundary conditions 
adopted for the orthogonal lattice underlying the neu- 
ronal structure. The first line of matrix A corresponds 
to the whole structure in this figure, starting from the 
upper left-most cell and following the arrows. The sec- 
ond line of A is obtained similarly, but the structure is 
mounted circularly from the element (2,2) of A, and so 
on. As a consequence of such assumptions, A becomes 
a circulant matrix. Observe that studies involving non- 
periodical boundary conditions can be approximated by 
using large image sizes N x N. 

The N 2 eigenvalues of the thus obtained adjacency ma- 
trix |7j of the whole two-dimensional network are hence- 
forth represented as Xi, i — 1,2, . . . , N 2 . As A is cir- 
culant, these eigenvalues can be immediately obtained 
from the Fourier transform of its first row. Observe 
that the simplicity and speed of such an approach al- 
low for systematic investigation of a variety of different 
neuronal shapes. As the cell reference point is assumed 
never to coincide with a dendrite point, we also have 
that 2r=i Ar — 0. As A is a non-negative matrix, there 
will always be a non-negative eigenvalue Am, called the 
dominant eigenvalue of A, such that A r < Am for any 
r = 1,2, ...,N. The spectral density (e.g. 0) of the 
adjacency matrix, defined in Equation^ where X p is the 
p— th eigenvalue of A, provides an additional way to char- 
acterize the topology of the obtained networks. 



P(A) 



1 N 



Ar) 



(8) 



r=l 



The eigenvalue Am, which depends on the specific dy- 
namics through which new edges are incorporated into 
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(a) (b) 

FIG. 7: Spectral density of the adjacency matrices obtained 
for the neuronal cells in Figure 01 considering A = 1 (a) and 
A = 5 (b). The crossed lines referes to the sparser neuronal 
cell. 



the network, represents an interesting parameter for char- 
acterizing the cyclic composition of complex networks. 
Figures Efa) and (b) show the real part (recall that the 
adjacency matrix for a digraph is not necessarily sym- 
metric) of the spectral density of the adjacency matrices 
obtained for the neuronal cells in Figure Ola) and (b) 
considering lattice spacings A = 1 and 5. The wider dis- 
persion of the spectrum of the denser cell in Figure Eta) 
reflects a higher potential for connections of that neu- 
ron in both cases. It is also clear that the separation of 
cells by A = 5 leads to a substantially smaller spectrum, 
with immediate implications for the respective neuronal 
connectivity. 

An additional morphological property of the spatial 
distribution of the connections is their respective lacunar- 
ity (e.g. [16(), which expresses the degree of translational 
invariance of the obtained densities. Figure [S] shows the 
lacunarities of the connection densities obtained for the 
two considered cells with respect to k = 1 to 4. It is 
interesting to observe that most of the lacunarity differ- 
ences are observed for k = 1, with similar curves be- 
ing obtained for larger values of k. At the same time, 
the denser cell led to lower lacunarity values. Given 
their immediate implications for neuronal connectivity, 
the above proposed set of neuronal shape measurements 
present specially good potential for neuron characteriza- 
tion and classification. 



IV. ASSOCIATIVE RECALL 

One of the most important functional properties of 
Hopfield neuronal networks is their associative recall, 
which can be quantified by the overlap measurement, 
obtained by comparing the originally trained and the re- 
covered patterns. A Hopfield network is completely de- 
termined by its respective connecting matrix, which in 
the case of the models considered in the present work 
is constrained by the adjacency matrix derived from 
the morphological structure in the sense that only the 
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(a) (b) 

FIG. 8: Lacunarities for the spatial distributions of connec- 
tions for the cells in Figure 0] 

weights corresponding to existing connections are allowed 
to vary [ljj . Therefore, the shape of the neuron has a di- 
rect impact on the performance of the network, which is 
chiefly dictated by the null-space of the adjacency matrix 
spectrum |l7j . The analytical approach introduced in the 
current work can be immediately used for the estimation 
of overlaps considering different neuronal shapes. 

In the standard Hopfield setup the cells are either firing 
(Si = 1) or silent (S 1 , = —1) and are updated according 
to the rule 

Si - siga{J2 JikSk) (9) 
k 

with synaptic strengths Jo- = £f£fc (Hebb rule) if 
i and k are connected, where £f = ±1, fi = 1, 2, . . .P, 
are P random bit-strings called input patterns, and one 
of them, perturbed uniformly along its extent, is sup- 
posed to be recalled by this updating rule (i.e. associa- 
tive memory). The quality of recall is measured by the 
overlap 'F = J2i if the first pattern is supposed to 
be recovered. 

We consider the simple prototypical cell patterns pre- 
sented in Figure El A network was obtained for each cell 
shape by using the above formalism, and a non-randomly 
diluted Hopfield model with such connection matrix was 
then implemented for the networks and serially repeated 
a hundered times to gain statistical significance. All three 
networks consists of 441 neurons and the memory model 
is set to recall 25 background patterns with 20 percent of 
noise. For efficiency's sake, the recovering stage stops 
whenever a stable point (or reasonable fixed limit) is 
reached. To incorporate the effect of changing the axons 
position, which is potential significant from the biologi- 
cal point of view, we disturbed the reference point of the 
axon random and gradually. This allowed us to study 
the robusteness of the memory model. 

Figure ^| shows the overlaps obtained while consider- 
ing three simple neuronal shapes, namely the artificial 
neuronal cell shown in Figure |^1 a line and a cross. For 
each cell pattern we have three overlap curves represent- 
ing respectively: the lattice as it is, a perturbed ver- 
sion with one percent of uniform noise (in pixels), and 





+ 



FIG. 9: Three prototypical cell shapes used in the morpho- 
logical Hopfield simulation. 




FIG. 10: The overlap curves for three diferent cell shapes 
shown in Figure [5] 
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FIG. 11: The spectrum of the A matrix (represented in the 
complex plane) for the three diferent cell shapes shown in 
Figure |5] the marked inset is zoomed in Figure fT^l 
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FIG. 12: The spectrum of the A matrix zoomed from the 
inset of Figure [TTI showing the spread in the distribution of 
eigenvalues for the considered patterns. 



another perturbed version with ten percent noise. Al- 
though the influence of such pertubations are masked 
by the stochastic nature of the system, we can see that 
as far the overlaps are taken as an indication of perfor- 
mance, the model is robust to network topology changes 
and sensitive to neuronal shape. An order clearly em- 
merged in the overlaps albeit, as indicated by the large 
deviation, it is a visibly degenerated morphological mea- 
sure. The more spattially distributed shapes tended to 
lead to better preformance. The eigenvalues for each of 
the three considered cases are illustrated graphically in 
Figure ^2 It is clear from this figure that the eigen- 
values tend to organize symmetrically with respect to 
the real axis. Also, the eigenvalue dispersions obtained 
for the cases line, cross and cell tended to be progres- 
sively broader, reflecting their original spatial structure. 
In other words, shapes more uniform and isotropically 
distributed along space tended to produce broader eigen- 
value distributions. The better overlap figures obtained 
for sparser patterns is closely related to the fact that 
more distributed eigenvalues are obtained in those cases, 
reducing the null space for memory representation. 



V. CONCLUSIONS 

An analytical approach to the characterization of neu- 
ronal connectivity was proposed and illustrated with re- 
spect to synthetic and real neurons. It was shown that 
the connections of progressive length established along 
the neuronal structure can be precisely quantified in 
terms of the autoconvolution of the function representing 
the individual shape of the neuron. The analysis of the 
connectivity pattern in terms of spectral dispersion and 



7 



lacunarity was also proposed and illustrated. In addi- 
tion, we have shown that, by assuming a specific type of 
periodical boundary condition, it is possible to construct 
a circulant matrix whose spectrum can be conveniently 
calculated and used to characterize the topological and 
functional properties of the neuronal structure. More 
specifically, we implemented Hopficld networks having 
weight matrices constrained by the adjacency matrices 
defined by the individual neuronal cell geometry. The 
performance of such networks, quantified in terms of the 
overlap measurement, were shown to be strongly related 
to the morphology of the adopted neurons. 

In addition to paving the way for the analytical char- 
acterization of the connections in regular neuromorphic 
networks, the framework proposed in this article can be 
immediately adapted to study the spread of waves of neu- 
ronal activity starting from the stimulus £{x,y), where 
the neurons are understood to accept input and produce 
output in synchronous manner at each clock cycle T. For 
instance, the situation where the neuronal cells output 
corresponds to the inner product between its shape and 



the respective area of the input space can be immediately 
characterized in terms of the eigenvalues and eigenvectors 
of precisely the same adjacency matrix A constructed as 
described above. Although the proposed methodology 
assumes identical, uniformly distributed neuronal cells, 
it is expected that they provide a reference model for 
investigating and characterizing real networks character- 
ized by a certain degree of regularity, such as some sub- 
systems found in the retina and cortex. Preliminary cor- 
roborations of such a possibility were provided by the fact 
that our overlap simulations tended to be robust to lat- 
tice perturbations. Mean-field extensions of the reported 
approach are currently being validated. 
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